//// 



F5=r 
z s : 

■53- - 

m 



Keyboard 




Mouse 




/ 


»\ 


7 






11 


VRAM 


\ 






1 Oisplay 1 




I device | 





Keyboard/ 

mouse 
controller 

5 




ROM 



14 



Serial 
port 



Parallel 
port 



wis 

To modem 

^18 

To printer 



Timer 



Communication 
adaptor card 



FDC 




■ (7 
FDD 








IDE controller 



To network 



20 



25 



HDD 



CD- 
ROM 



27 



SCSI controller 



p i 



81 




MO 

7> 



24 



CD- 
ROM 

o 



HDD 



100 



Fig. 1 



<SiJn 



y 2 



Application 
211 



Acquire sentence 
group to be 
recognized 



Control 



Voice 
input unit 

209 



Speech 
recognition 
engine 

201 



X 



Speech 
recognition 
dictionary 

2S1 



Recognition 
processor 

201 



Unknown 

word 
detector 

285 



I 



Unknown 

word 
detection 
dictionary 

233 



Base form 
generator 




Pronunciation 
dictionary 

23S 



. 3/H 



Word inscription 311 


Tahara 


Sounds- like _ n _ 
spelling 2H£ 


Pronunciation «nc 
inscription =£2. 


Sounds - like * n 
spelling score SH£ 


Tahara 


tahara 


0.83 


Tawara 


tawara 


0.56 


Tabara 


tabara 


0.45 


Tabaru 


tabaru 


0.20 


Dahara 


dahara 


0.02 



100 



Fig. 3 



■ r~ 1 

Pronunciation inscription 


m 


Koushi 


Base form 313 


Pronunciation *«e 
score fifi 


Base form 1 


0.74 


Base form 2 


0.58 


Base form 3 


0.37 



810 



Fig. 4 



Hi » 



( Start 



Obtain target sentence 
NS (i) (1 2i £ sentence countN) 



i 



.403 



K For i - 1 to N J 



Divide sentence NS (i) into 
segments W (n) (1 5 n % M) 



< 



.407 



ra *- 1 



< For n = 1 to M > 



T-409 



413 



Is W (n) 



unknown 




^^^word2^^ 








^415 


U(m) - W(n) 


\ 


F 


^417 


m *— 


m+1 













Next n 



6 



V-4H 



Fig. 5 




V 

Unknown word count N *- m [ 



423 
425 




Prepare voice command while S (i) 
is defined as a set of W (n) I 



Next i 
V 



Fig. 6 



6/tl 



{fa \" 1 to 



I 451 



unknown word count M )4 



Prepare pronunciation B (L J (I)) 
for unknown word U (i), 
and calculate score S (I. J (I)) 



459 
461 



_ . „ . ^ No Pronunciation 
A- FALSE h ~ generated? 



I 




,455 



n~ 1 



"L-4S5 



Acquire combination of NS 
and n - th pronunciation 



.487 



0 




End 



y 



471 



Fig. 7 



W// 




Fig. 8 



?/// 




Next combination 



Y 

Y 




Yes 




545 



Result - TRUE 



I 



525 



( End 



J(arg)~ J(Arg)+l 



-535 



1 



J(arg) - 1 



Result - 


- FALSE 




Result * 


- TRUE 




•4 ■ 1 





.541 
-54J 



Fig. 10 



io/u 



( Start 



Recognize voice command | ^ 553 

Acquire recognition result L.555 
(sentence) R J 




565 



Execute necessary action 
(jump to linking destination) 



Reduce threshold value 
TH — TH * 0.5 



i 



Register unknown word 



571 



s 



577 




Display recognition error 

— crz 



-S7J 



."Ill , ^ 



Example 1 r«jfe/m«/%T«5t/A</ES/^e/aiH^/S"P/5ifiJ 
601 602 603 604 605 606 6^7 608 609 

Example 2 riBM/<P/ e - \£V*7./ tfi/im/tzl ——610 
611 61*2 613 614 6^5 616 



Example 3 r Pervasive/ Computing/DevelopmentJ — —620 

\ \ \ 

621 622 623 

Example 4 ffi/O/SlKl/IJ/lp^Tf J— — 630 
631 632 633 634 635 636 



Example 5 U01 (k) /mutual/fund/strategyj — —640 
\ \ \ \ 

641 642 643 644 



